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Abstract. In game theory, the concept of Nash equilibrium reflects the collective stability 
of some individual strategies chosen by selfish agents. The concept pertains to different 
classes of games, e.g. the sequential games, where the agents play in turn. Two existing 
results are relevant here: first, all finite such games have a Nash equilibrium (w.r.t. some 
given preferences) iff all the given preferences are acyclic; second, all infinite such games 
have a Nash equilibrium, if they involve two agents who compete for victory and if the 
actual plays making a given agent win (and the opponent lose) form a quasi-Borel set. This 
article generalises these two results via a single result. More generally, under the axiomatic 
of Zermelo-Fraenkel plus the axiom of dependent choice (ZF+DC), it proves a transfer- 
theorem for infinite sequential games: if all two-agent win-lose games that are built using 
a well-behaved class of sets have a Nash equilibrium, then all multi-agent multi-outcome 
games that are built using the same well-behaved class of sets have a Nash equilibrium, 
provided that the inverse relations of the agents' preferences are strictly well-founded. 



1. Introduction 

Game theory is the theory of competitive interactions between decision makers having 
different interests. Its primary purpose is to further understand such real-world interactions 
through mathematical modelling. Apart from some earlier related works, the field of game 
theory is usually said to be born in the first part of the 20th century, especially thanks to 
von Neumann [9], but also Borel pQ and some others. Since then, it has been applied to 
many concrete areas such as economics, political science, evolutionary biology, computer 
science, etc. Conversely, specific problems in these concrete areas have been triggering new 
general questions and have thus been helpful in developing game theory. 

Surprisingly, game theory has also provided useful point of view and terminology to 
abstract areas such as logic and descriptive set theory. For instance, Martin [7] relates 
(quasi-)Borel sets to the existence of winning strategies in some two-agent win-lose games, 
i.e. games that involve only two players and two outcomes saying who wins. Conversely, 
one may wonder if and how such specific results may help develop general game theory. 
Especially, do such results scale up when considering the same game structure for many 
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agents, many outcomes, and the usual generalisation of the notion of winning strategy, 
namely the notion of Nash equilibrium? 

This paper answers the question positively by proving a transfer theorem for infinite 
sequential games: if all two-agent win-lose games that are built using a well-behaved class of 
sets have winning strategies, then all (reasonable) multi-agent multi-outcome games that are 
built using the same well-behaved class of sets have Nash equilibria. Since the quasi-Borel 
sets are well-behaved and guarantee existence of winning strategies (as proved in [7] ) , the 
application of the transfer theorem implies that all (reasonable) multi-agent multi-outcome 
games that are built using quasi-Borel sets have Nash equilibria. Martin's result is thus 
generalised by invoking Martin's result itself, which factors out most of the proof burden! 

Section fTTTI sets some notations; Section [L~2l describes the main result quickly; Section [L~3l 
recalls related previous works; Section 11.41 recalls preliminary definitions and properties, 
mostly about well-foundedness; Section [2] introduces the main result in detail; Section [3] 
applies the transfer theorem to quasi-Borel determinacy and to the axiom of determinacy. 

1.1. Notations. Let C be a set. The following lists useful notations of well-known notions. 

• Outer universal quantifiers are sometimes omitted in formal statements. 

• In formal definitions, x := y means that x is defined as y. 

• C* is the set of finite sequences over C, and e is the empty sequence. 

• I7I is the length of 7 G C*, and 7 = 7071 . . . 7| 7 |-i- 

• C 2 * (resp. C 2 * +1 ) is the set of finite sequences of even (resp. odd) length. 

• is the set of infinite sequences over C. It is endowed with the product of the 
discrete topology on C. 

• For 7, 7' G C*, let 7 • 7' (or 77') denote the concatenation 70 • • • 7| 7 |_i7q . . . 7iyi_ 1 - 

• For 7 G C* and 7' G C w , let 77' denote the concatenation 70 . . . 7| 7 |-i7o7i72 • • • 

• For ICC* and FCC'u , let XY denote the concatenations of one element in 
X and one element in Y. 

• 7C7' means that 7 is a prefix of 7' for 7 G C* and 7' G C* U C u . 

• C <n := {7 G C* I I7I < n} are the sequences over C of length shorter than n. 

• 7 <n is the prefix of length n of 7 G (C* U C w )\C <n , in particular 7<o = e. 

• s :C C* — > C means s : dom(s) —> C where dom(s) C C*. 

• s \x denotes the restriction of the function s to X. 

• If s :C C* — > C and s' :C C* — > C, then writing sUs' requires that dom(s) H 
dom(s') = 0, in which case s U s' :C C* — > C is the function such that s U s'^j) is 
either not defined, or equal to s(7) if 7 G dom(s), or equal to ^'(7) if 7 G dom(s'). 

1.2. The main result. An infinite sequential game may involve infinitely many playing 
agents who play in turn. At each turn, one agent chooses an element in a given set of 
choices, and this specific choice determines the next agent who has to choose an element in 
the same set of choices, and so on. Each such an infinite sequence of choices is (objectively) 
summarised via an outcome, and each agent gives the outcomes a (subjective) meaning by 
comparing them via an individual binary relation. 

Definition 1.1 (Infinite sequential game). An infinite sequential game is an object 
(A, C, d, O, v, (^ a )a£A) complying with the following. 

• A is a non-empty set (of agents). 



INFINITE SEQUENTIAL NASH EQUILIBRIUM 



3 



• C is a non-empty set (of choices). 

• d : C* — > A (assigns a decision maker to each stage of the game). 

• O is a non-empty set (of possible outcomes of the game). 

• v : C w — > O (uses outcomes to value the infinite sequences of choices). 

• Each -< a is a binary relation over O (modelling the preference of agent a). 

Notice that letting the function v from Definition 11.11 map a clopen ball to the same 
outcome simulates a finite play ending with this outcome; also notice that a game with 
different sets of choices at each turn may be simulated by considering the union of these sets. 
Therefore, the above-defined infinite sequential games capture (most of) the competitive 
sequential processes that do not involve complex concepts such as time or knowledge. 

In such a game, a strategy of an agent is a function saying what the agent would choose 
at every possible stage of the game where the agent is the actual decision maker. A strategy 
profile is a combination of one strategy per agent, as defined below. 

Definition 1.2 (Strategy). A function s : C* — > C is called a strategy profile. A function 
s a : d _1 (a) — > C is called a strategy for agent a. 

Starting from the root of the game-tree and recursively following the unique choice 
made by the current decision maker yields an infinite sequence, or play, as defined below. 

Definition 1.3 (Induced play and outcome). Let s : C* — > C be a strategy profile. The 
play p = p(s) € C u induced by s is defined inductively through its prefix: p n := s(p <n ) for 
all n £ N. One may also say that v op(s) is the outcome induced by s. 

The agents actually compare the strategy profiles via their induced outcomes, like in 
Definition 11.41 below. Notice that unlike the traditional definition of Nash equilibrium, the 
definition below uses two concepts: convertibility, i.e. the ability of an agent to convert 
a strategy profile into another one, and preference. Furthermore, the preferences here are 
conceptually (slightly) different from the traditional notion of preference in game theory 
since they are not involved in the definition of Nash equilibrium in the same way. See [5] 
for a detailed discussion on the matter. 

Definition 1.4 (Sequential Nash equilibrium). Let {A,C,d,0,v,(~< a ) a& A) be a game. A 
strategy profile s : C* —> C is a Nash equilibrium if all agents are stable, where an agent a 
is stable if he or she prefers v o p(s') over v op(s) for no s' that coincides with s outside of 
the subdomain d~ 1 (a), said otherwise for no s' into which agent a can convert s. 

NE(s) := Va <E A, stable(s,a) 
stable(s,a) := W G C* -> C, ->(s — ^ a s' A v o p(s) -< a v o p(s')) 

S s' := S \c*\d~ 1 (a)= s ' lc*\d-l(o) 

Under the axiomatic of Zermelo-Fraenkel plus the axiom of dependent choice (ZF+DC), 
the theorem below is the main result of this article. (Note that Condition (4) in the theorem 
refers to two-agent games where one may either win or lose, and where determinacy means 
that one of the agents can win for sure, as will be defined formally in Sections 11.31 and 11.41 ) 

Theorem 1.5. Let (A,C,d,0,v,(^ a ) a£ A) be an infinite sequential game. Let V C 7 7 (C aj ) 
and assume the following. 

(1) O is well-orderable. 

(2) is strictly well-founded for all a G A. 

(3) VO' C 0,V(c, 7 ) eC xC*, v- l (0') Hj(C- {c})C ,UJ G T 
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(4) The game (C, D, W) is determined for allWGT and D C C*. 
Then the game {A,C,d,0,v,(~<a)aeA) has a Nash equilibrium. 

Conversely, it is foreseeable that non well-founded preferences may lead to games with- 
out equilibrium, as proved later. Well-foundedness is therefore a key notion in game theory! 

Conditions (3) and (4) above reflect the set-theoretic complexity of the distribution of 
the outcomes onto the infinite sequences of choices. For a large class of "simple" sets, i.e. 
the quasi-Borel sets, a folklore extension of quasi-Borel determinacy will make Conditions 
(3) and (4) hold for countable sets O, thus generalising Martin's result [7J. 

1.3. Previous works. This section presents two existing results that are generalised by 
Theorem 13.2} as well a similar existing results. First of all, a Gale-Stewart game is an 
infinite sequential game involving just two agents who play alternately and two outcomes 
saying who wins. Let us call a the agent who plays first, and b the opponent. 

Definition 1.6 (Gale-Stewart games). A Gale-Stewart game is an object (C,W) where 
C is a non-empty set (of possible choices at each step of the game) and W is a subset of 
C w ( and represents the winning set of agent a among the infinite sequences over C , while 
C W \W is the winning set of agent b). 

Following Definition 11.21 t ne strategies of agent a (resp. b) are the functions of type 
C 2 * -4 C (resp. C 2 * +1 -)• C). The notion of induced play follows Definition Ol 

In such specific games, it is natural to ask who wins, or said more carefully, whether 
one agent may actually win for sure. 

Definition 1.7 (Winning strategies and determined games). Given a game (C, W), a strat- 
egy s a : C 2 * — > C is a winning strategy for agent a if p(s a U s&) G W for all Sb ■ C 2 * +1 — > C . 
Likewise, a strategy s& : C 2 * +1 —> C is a winning strategy for agent b if p(s a U s&) ^ W for 
all s a : C 2 * — > C . The game is determined if either of the agents has a winning strategy. 

It turns out that the quasi-Borel sets, a large class of sets that are defined below (almost 
verbatim from [7]), enjoy nice determinacy properties such as in Theorem 11.91 

Definition 1.8 (Quasi-Borel). Given a topological space X the quasi-Borel sets of X form 
the smallest class T of subsets of X containing all open sets and closed under the operations: 

(1) complementation; 

(2) countable union; 

(3) open- separated union. 

Here A comes from {Bj \ j G J} by the operation of open- separated union, or, equivalently 
A is the open- separated union of {Bj \ j £ J}, if 

a) A = U{Bj | j £ J}; 

b) there are disjoint open sets Dj, j G J, such that Bj C Dj for each j G J. 

Notice that the two notions of Borel sets and quasi-Borel sets coincide for Polish spaces, 
e.g. when C is countable in Theorem 11.91 below. 

Theorem 1.9 (Martin [7J). Let C be a non-empty set and W be a quasi-Borel set of C w . 
Then the game (C, W) is determined. 
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Actually, this paper does not only generalise quasi-Borel determinacy from descriptive 
set theory, but also a (much simpler) result [I] [5] from multi-agent multi-outcome finite 
game theory: given agents, outcomes, and preferences from which one is allowed to build 
games, every finite sequential game has a Nash equilibrium if and only if the preferences 
of the agents are all acyclic. Note that this result is already a generalisation of existence 
of Nash equilibrium for real- valued finite games in extensive form, see [3], and existence 
of Nash equilibrium for finite games in extensive form with abstract outcomes and strict 
weak orders for agent preferences, see [10]. Likewise, quasi-Borel determinacy is already a 
generalisation of [2], [13], and Borel determinacy [6]. 

Note that the idea of strengthening determinacy results for more general notions of 
equilibrium is not a novel idea: it has already been studied in parity games and Muller 
games, e.g., in [12] and [TT], respectively. 

1.4. Preliminaries. Let us first generalise slightly the notion of Gale-Stewart games, as 
is used in Theorem ll.5[ or equivalently Theorem 12.91 In these new games, in addition to 
the set of choices C and a winning set W, the nodes where agent a makes decisions are 
represented by a subset D C C* of finite sequences of choices. 

Definition 1.10 (Infinite two-agent win-lose sequential games). Such a game is an object 
(C, D, W) complying with the following. 

• C is a non-empty set. 

• D is a subset of C* . (D represents the stages of the game where agent a makes 
decisions.) 

• W is a subset of C w . 

Similarly as for Gale-Stewart games, strategies of agent a are functions s a : D —■ C 
and strategies of agent b are functions Sb ■ C*\D — > C. The notion of induced play follows 
Definition 11.31 an d winning strategies and determinacy are also defined similarly. Note that 
the Gale-Stewart games can be encoded as infinite two-agent win-lose sequential games 
(take D := C 2 *), which can in turn be encoded easily as infinite sequential games. Such 
an encoding is moreover faithful w.r.t. Nash equilibrium: in an infinite two-agent win-lose 
sequential game, s a U Sfr is ci Nash, equilibrium iff eith.6r s a or Sb is a winning strategy. 

Let us now recall some set-theoretical results that are used in Section [2l First, the 
following lemma is a well-known folklore result from set theory. 

Lemma 1.11 (Well-ordered extension). Let R C E x E be a (strict) well-founded relation 
and assume that some -<o well-orders E (strictly). Then there exists a (strict) well-ordering 
-< of E that includes R. 

Proof. Following chapters 2D and 2G in [8], let us define a rank function p : E — > A 
recursively, where A is an ordinal of cardinality \R\. So p(x) := sup{p(y) + 1 | yRx}. Let 
-<C E x E be as follows. 

x <y:= p(x) < p{y) V (p(x) = p(y) A x ^ y) 
The relation -< includes R. Indeed, assume that xRy, so p(x) + 1 < p(y) by definition 
of p, that is, p(x) < p(y). Therefore x -< y by definition of -<. 

The relation -< is linear order, as proved below. Assume that x < y and y -< z. 
If p(x) < p(y) or p(y) < p(z) then p{x) < p(z), and therefore x -< z by definition. If 
p(x) = p(y) = p(z) then x -<o y and y -<o z , so x -<o z by transitivity of ^o, so x -< z by 
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definition. Moreover -< is irreflexive since < and -<o are irreflexive. Finally, if x ^ y then 
either p(x) < p(y) V p(y) < p(x) or p(x) = p(y) (knowing x -<o U V U x )- Both cases 
yield x -< y V y -< x. So ^ is a strict linear order. 

The relation ~i is also well-founded: Let S be a non-empty subset of E. Since ordinals 
are well-ordered by <, let a be the <-minimum of the set p(S). So {x G E \ p(x) = a} ^ 0. 
Since E is well-ordered by -<q, let m be the -<o-minimum of {x G E \ p(x) = a}. Now let 
y G S — {m}. If a = p(m) < p(y) then m -< y by definition; if p(m) = p(y), then m -<q V 
by construction, so m -< y. Therefore m is a -^-minimum of S. □ 

Terminal intervals (as opposed to initial) are defined below. They are sometimes also 
called upper sets in the literature. 

Definition 1.12 (Terminal interval). Let < be a strict linear order over E. The <-terminal 
intervals are the subsets I of E that satisfy the formula x<yAx£l^ i/ £/. 

Observation 1.13 (Well-ordering of the terminal intervals). Let (E, < _1 ) be a strict well- 
order. Then the <-terminal intervals are (strictly) well-ordered by set-theoretic inclusion. 

2. Infinite sequential games 

This section presents concepts and properties of increasing complexity, and culminates 
in the proof of the main theorem of the paper. 

The notion of play induced by a strategy profile is extended below into the notion of 
possible plays under constraints, namely plays that are compatible with a partial strategy 
profile, as clarified by Lemma 12.2151 

Definition 2.1 (Possible plays under constraints). 

Vs :C C* -> C, P{s) := {p G C w | Vn G N, p <n G dom(s) => s(p <n ) = p n } 

Lemma 2.2. Let C be a non-empty set. 

(1) P{s U s') = P{s) n P(s'), hence s C s' implies P(s') C P(s). 

(2) V 7 G dom(s), P(s | 7 c*) n jC» = P(s \^ )c *) H tKt)^ 

(3) V 7 i dom(s), P(s | 7C *) n 7 C" = \J ceC P(s | 7cC7 *) n ycC" 

(4) P(s | 7C .)n 7 ^cp( s ). 

f5j P(s) = {p(t) | t :C* ->C At \ dom(s) = s} 

Proof. 

(1) By definition. 

(2) Assume that 7 G dom(s). 

P £P(s | 7 c*)n 7 <^ 
t 

7 E p A VnGN, 7 C p <n A p <n G dom(s) s(p <n ) = p n 

t 

7 jZ p A s( 7 ) = p| 7 | A Vn G N, 7a (7) C p <n A p< n G dom(s) s(p <n ) = p n 

t 

7s(7) EP A Vn G N, 75(7) C p <n A p<„ G dom(s) s(p <n ) = p n 

t 

P eP(s | 7s(7) c0 n 7«(7)C W 

(3) Proof similar to the one above for Lemma 12.2121 
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(4) By induction on 7 and Lemmas 12.2131 and 12.2121 

(5) By double inclusion. Let p G P(s) and let us define t : C* — > C such that t \dom(s) := s 
and £(7) := p\j\ for all 7 G C*\dom(s). By construction t \dom(s)'- = s an d p(t) = P- 
Conversely, let t : C* — > C such that i |dom(s) := s - Let n G N and assume that 
p(t)< n G dom(s), so s(p(t) <n ) = t(p(t) <n ) = p{t) n by assumption and by definition 
of the function p respectively. 

□ 

Given a an agent, 7 a finite sequence of choices, and s a strategy profile, let us consider 
the plays starting with prefix 7 and satisfying the constraint given by s |^-i( a ) in the 
subgame rooted at node 7 (so that there is at least one such play). This subset of plays 
is pointwise mapped to a subset of outcomes by the valuation function v. The smallest 
"upper set" (according to the preference of a) including this subset of outcomes represents 
the guarantee of the agent a under the above constraints. This is formally defined below. 

Definition 2.3 (Agent guarantee). Let {A,C,d,0,v, (< a ) agj 4) be a game where the < a are 
strict linear orders, and where x < a y means x < a y V x = y. 

Va G AV7 G C*,Vs : C* -> C, 

g a (j,s) :={oeO | 3p e P(s | rf -i (o )n 7 c*) n -{C^, v(p) < a 0} 
Lemma 2.4. Let (A,C,d,0,v,(< a ) a £A) be a game where the < a are strict linear orders. 

(1) g a {n,s) is the smallest < a -terminal interval including v(P(s |<i- 1 (o)n7C*) H7C W ). 

(2) Ifd(i) = a then g a {"f,s) = ^(75(7), s). 

(3) Ifd{i) / a then g a (-f,s) = U c( z C 9a(lc, s). 

(4) If s |c*Yn'c*= t |c*Yr/c* a ^d g a {ll\s) C ^(77', t), then g a (-f,s) C g a (j,t). 
Proof. 

(1) Let (0,0') G 5a(7)S) x O be such that o < a o' and let I be a < a -terminal interval 
including v(P(s | d -i( a )n 7 c«) n l cu) )- Let P e p ( s \d^(a)n-yC*) n 7^* such that 
v{p) < a o, by Definition 12.31 On the one hand, v(p) < a o' by transitivity, so 
d G 5a (7 > s )> which shows that <7 a (7, s) is a < a -terminal interval; on the other hand, 
since v(p) G I by inclusion assumption, o is also in / by terminal assumption. 

(2) By rewriting Definition 12.31 using Lemma 12.2121 

(3) By rewriting Definition 12.31 using Lemma 12.2131 

(4) By induction on 7'. The base case 7' = e is clear. For the induction step, assume 
that s |c*\ 77 'cC* = t lc*\77'cC* f° r some c G C and that g a {ll'c,s) C g a (jj'c,t). 
Then g a {ll'-,s) C 30(77', t) by case-splitting on whether ^(77') = a (and in case 
yes, whether c = 5(77'))) by both assumptions, and by Lemmas 12.4131 and 12.4121 
Therefore g a {l-,s) C g a {^-,t) by induction hypothesis. 

□ 

Assume a finite sequence of choices 7 as fixed constraint. By choosing different strategies 
as additional constraint, the agent a may obtain different guarantees. Informally, since the 
agent may prefer smaller upper sets of guarantee, the infimum of these available guarantees, 
i.e. their intersection, is a relevant notion defined below. 

Definition 2.5 (Best guarantee). Let (A, C, d, O, v, (< a )aeA) be a game where the < a are 
strict linear orders. 

Va£A,\/ 7 eC*, G a (i):= f| g a (j,s) 

s-.C'^C 
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The lemma below says that, under a well-ordering condition, an agent can maximise 
his or her guarantee, i.e. secure the best possible guarantee. 

Lemma 2.6. Let (A,C,d,0,v,(< a )a£A) be a game. If the <~ 1 are strict well-orders, then 
the following holds. 

Proof. Let a G A and 7 € C* . By Lemma f2.4lll the g a (7> s) are non-empty terminal intervals 
for all s. By Observation II . 131 these terminal intervals are well-ordered by inclusion, so the 
(non-empty) set {g a (7j s ) I s : C* — > C} has a minimum g a ( 7 , fiZ) for some witness and 
the minimum equals G a (j) by Definition 12,51 □ 

Given an infinite sequential game, the definition below builds a special strategy profile 
as follows. Start with a dummy strategy profile and let the root owner change his or her 
own strategy to maximise his or her guarantee at the root, unless it is already maximal. 
Now move to the node of the infinite tree that is (newly) chosen by the root owner, and let 
the new node owner maximise his or her guarantee at this node, and so on. 

Definition 2.7 (Deepening the guarantee). Let (A, C, d, 0,v, (< a )aeA) be a game where 
the < a ~ 1 are strict well-orders. Let sq : C* — > C be, e.g., a constant strategy profile, and 
let us define a sequence of strategy profiles inductively: let us assume that s n is defined, let 
7 := p(s n ) <n , let a := d( 7 ), and let us define s„+i as follows. 

• If g a {l,s n ) = G a {pf) then s n+ i := s n . 

• Otherwise s n+1 := s n \c»\[dr 1 {a)rr l C*) U-i( a )n 7 C* 
where fi2 is a witness from Lemma \2.6l 

As proved below, the deepening process converges to a strategy profile that maximises 
guarantees along its play, at each node and for the node owner. Note that the process 
modifies strategies only when necessary, otherwise it could fail even for a one-player win-lose 
game: consider the game ({0, 1}, {0, 1}* , {0, 1} U — {O 1 ^}), which matches Definition II .101 It 
is basically played by one single agent who wins if managing not to choose the zero sequence. 
If the deepening process allowed modifications of optimal strategies, for all n the agent could 
choose some s n inducing n l CJ , and the limit strategy would make the agent lose. 

Lemma 2.8 (Properties of the deepening). Recall (s n ) nG pj from Definition \2.1\ 

(1) S n+k \c*\p{s„) <n C*= s n \c*\p{s„) <n C* 

(2) Let a : C* — > C be such that (7(7) := si 7 n ^7) for all 7 G C* . The sequence (s n ) n€ N 
converges towards a; more specifically s n+k \c*\ P (s n ) <n c*= ° \c*\ P (s n ) <n c* ■ 

(3) p{s n+k ) <n =p <n , where p :=p(cr). 

(This result and notation are often used implicitly in the rest of the article.) 

(4) d(p <n ) = a 9a(p<n, S n +l) = G a (p <n ) 

(5) Va G A, g a (j><n+l, s n +l) C g a (p<n,s n +i) C g a 

(6) d{p <n ) = a g a (P<n, Sn+l+fc) = G a (p <n ). 

(7) d(p <n ) = a g a (p<n,o-) = G a (p <n ) 

Proof. 

(1) First prove p{s n+ k)<n = p{s n )<n by induction on k and Definition 11.31 then use it 
to prove the claim by induction on k. 

(2) By Lemma EEH1 

(3) By Lemma EHE 
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(4) By case splitting along Definition 12.71 and using Definition 12.31 

(5) Ud(p <n ) = a, let h := g a (p <n+1 , s„+i); so h = g a (p(s n+1 ) <n+1 , s n+1 ) by Lemma[2J313J 
so h = g a (p(s n+ i) <n s n+ i(p <n ),s n+ i) by Definition [L3] of the induced pl ay, so 
h = g a (p(s n +i)<n,s n +i) by Lemma so h = g a (p<n,s n +i) by Lemma 
again, so h = G a (p <n ) by Lemma 12.8141 so h C g a (p <n ,s n ) by Definition 12.51 
Alternately, if d(p <n ) ^ a, then g a (p <n+1 , s n+1 ) C # a (p<n, Sn+i) = g a (p <n ,s n ) re- 
spectively by Lemma [2.4131 and since s n+ \ \d- 1 ( a ) = s n \d- 1 (a) by Definition 12.71 

(6) By induction on the number of j between (arbitrary) n + 1 and n + k such that 
s j \d- 1 (a)¥ z s j+i \d- 1 (a)^ *- e - intuitively, the number of times that agent a refines 
its strategy. Base step, there is no such j, so s n+ i \d- 1 ( a ) = s n+i+k \d- 1 (a)-> so 
9a(p<n, s n+ i+k) = g a (p<n,s n +i) = G a (p <n ) by Definition E31 and Lemma ESE 
respectively. Inductive step, let j be the minimal such j, so g a (p<j, Sn+i+fc) = 
G a {p<j) ^ 9a(p<j,Sj) by induction hypothesis and Definition 12. 5 1 respectively. It 
implies g a (p<n, Sn+i+fc) ^ 9a ip<n,Sj) by Lemma E3H since s n+1+k \c*\ P<j c*= 
s i \c*\ P<] c* by Lemma [2J3U But g a (p <n ,Sj) = g a (p <n ,s n +i) = G(p <n ) respec- 
tively since Sj \d- 1 ( a ) = s n+i \d- 1 (a) (by definition of j) and by Lemma [2.814} so 
9a{P<ni Sn+l+k ) C G( P< 

n ) ■ 

(7) By Lemmas 12.8151 and 12.4111 and Observation 11.131 the sequence {g a {p<k-, Sk))keN is 
constant from some ko onwards. (Intuitively, no agent can keep on refining his/her 
strategy infinitely often -when moving deeper and deeper along the play p being 
defined- because each refinement involves a strict improvement according to a pref- 
erence that has no infinite ascending chain.) Because of Definition 12 .71 it implies that 
the sequence (s^ |^-i( a )) is constant from ko onwards, therefore equal to a |^-i( a ). 
So g a (p<n,cr) = 9a(p<n,s n +k +i), which is equal to G a (p <n ) by LemmaESEl 

□ 

The proof of the theorem below builds a Nash equilibrium that shares the same induced 
play p with the limit strategy profile a from Lemma 12.81 The idea is that at each node 
along p, the node owner is threatened by the opponents collectively that deviating from p 
would not yield any better outcome than v (p). Such local, collective, threatening strategies 
exist for two combined reasons: by Lemma 12.8171 at a given node along p, the node owner 
cannot secure any better outcome than v(p), so by determinacy assumption, the opponents 
can collectively exclude the outcomes that are better than v(p) for the node owner. 

Theorem 2.9. Let (A,C,d,0,v,(~< a ) a £A) be an infinite sequential game. Let V C V{C U ) 
and assume the following. 

(1) O is well-orderable. 

(2) -<~ l is strictly well-founded for all a € A. 

(3) vo' c o,v(c, 7 ) g c x c*, v - l {o') nj(c- {c})c w e r 

(4) The game (C, D, W) is determined for all W € T and D C C* . 
Then the game {A,C,d,0,v,(~< a ) ae A) has a Nash equilibrium. 

Proof. It suffices to prove the claim when the -i^ 1 are strict well-orders. Indeed, by 
Lemma 11.111 and Assumptions [T] and [51 each of the ^J" 1 is included in some strict well- 
order, and any Nash equilibrium using the strict well-orders as preferences would be also a 
Nash equilibrium according to the original preferences, by Definition 11.41 So assume that 
the -<~ 1 are strict well-orders. 
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Recall a and p = p(cr) from Lemma 12.81 At each node of the play p, let us define one 
win-lose game involving the owner of the node versus the other agents. Let n G N, let 
a := d(p <n ) and let g n := {C,D n ,W n ) where D n := d~ 1 {a) U (C*\p <n C*) and W n := {pf G 
V<n{C-{ Pn })C" | v(p) < a v{p')}. Since W n = P<n (C - { Pn })C" Dv' 1 {o G O \ v(p) ^ a o}, 
it is in r by Assumption [3j So the game g n is determined. 

Now let us prove that agent a loses the game g n . By contradiction, let s be a strat- 
egy profile such that s \d„ is a winning strategy for agent a in the game g n . Let h := 
p (s U-i(a)np< n C*) n P<nC w > so that h = P(s \p n n P<n c*) np <n C" ' since d -1 (a) np<„C* = 
-Dn n p <n C* by definition of D n , so /i C .P(s |d„) by Lemma 12.2141 Since s \u n is winning, 
P(s \d„) Q W n by Lemma [2.2151 and W n C w _1 {o G O | ^ a o} by definition of W n . 
Combining these equalities and inclusions yields P(s |d-i( )np<„c*) H p< n C w C v~ l {o € 
O | vjp ) -<g o}, so G a (p <n ) C g a (p<n,s) C {o G O I u(p) ^ a o} by Definition E5] and by 
Lemma T2.4IH respectively. Now recall that p := sop£ P(cr |d-i( a )np<„c*) by Defini- 

tion [2TT1 so u(p) G gaiPKn,^) = G a {jp <n ) respectively by Definition 12.31 and Lemma T2.8I71 
Since v(p) £ {o G O \ v(p) -< a o} by definition, it contradicts the above inclusion. So let t n 
be a winning strategy for the opponent of agent a in the game g n , so that P(t n ) D W n = 
by Lemma 12.2151 

Now let us construct a strategy profile by appending the local threats t n to the special 
play p. Let us define s as follows, and note that p(s) = p. 

• Vn G N, s(p <n ) := p n 

• Vn G N, Vc G C - {p n }, V7 G C*, s(p< n C7) := t n (p <n cy) if d{p <n c-f) ^ d{p <n ) and 
s(p< n C7) := c otherwise 

Let us eventually prove that s is a Nash equilibrium, according to Definition 11.41 Let 
a be an agent, let s' : C* — > C be such that s' \c*\d- 1 (a) = s \c*\d- 1 (a)^ let p' '■= p( s ')i an d 
let us show that ->(v(p) -< a v(p')). If p' = p then -<{v(jp) -< a v(p')) by irreflexivity of strict 
well-orders, so now assume that p' / p. Let m be such that p' <m = p< m and p' m 7^ p m , 
so s'(p <m ) ytz s(p <m ) by Definition 11.31 Since s' \c*\d- 1 (a) = s \c*\d- 1 (a) by assumption, we 
have d(p <m ) = a, so s' \ p > <m+1 c*\ d -i (a)= a \ P ' < m+1 c*\ d-i(a)= *m l P ' <m+1 c* by definition of s, 
so {p'} = P(s') C P(t m ) by Lemmas E2E] and EMI Moreover recall that P(t m )C\W m = 0, 
so p' G p< m (C — {p m })C u \W m by definition of m, so v(p') -< a v{p) by definition of W m . D 

3. Applications of the transfer theorem 

The two applications in this section, Theorems 13.21 and 13.31 are two "extreme" corollar- 
ies of Theorem 12. 91 First, Theorem 13.21 generalises the quasi-Borel determinacy [7] (which is 
proved in ZFC). Second, Theorem 13.31 assumes the determinacy of all sets (which is incon- 
sistent with ZFC) and derives existence of Nash equilibrium for all infinite sequential games, 
provided that the inverse relations of the agents' preferences are strictly well-founded. Be- 
tween these two extremes, one may also instantiate Theorem 12.91 with classes Y of various 
complexity together with determinacy assumptions for Y. 

Before stating Theorem 13.21 let us address a slight issue, and since the solution of 
the issue belongs to the folklore, the related definitions and proofs will be only sketched. 
The issue is: Martin [7] formally proved determinacy of quasi-Borel sets only for games 
where agents play strictly alternately, i.e. in games (C,W), whereas Theorem 12.91 requires 
a determinacy statement for games (C,D,W). 
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The folklore solution is: For each game where the two agents play in no specific order, 
let us translate it in a new game where the agents play alternately as follows. Each time 
the same agent would play twice in a row, let us force the opponent to play a dummy move 
in between. This dummy insertion transforms each finite/infinite sequence of moves in the 
original game into a new finite/infinite sequence of moves. The new winning set of an agent 
is the image of his/her old winning set by the insertion function, union a set that makes 
the opponent lose when refusing to play the dummy moves as prescribed. Strategies are 
naturally translated along the insertion, and a winning strategy in the new (Gale-Stewart) 
game is eventually translated back into a winning strategy in the original game. 

More formally, let g := (C,D,W) be a game, assume without loss of generality that 
e £ D, and let us define an insertion function i : C* — > C* inductively as follows, where 
Co £ C is fixed and 7 £ C* and c £ C are arbitrary. 

• t(e) := e 

• i{^fc) := l(^)ccq if 7 £ D <^ 7c £ D 

• /-(7c) := i{j)c if 7 £ D <fc> 7c £ D 

Let us extend 1 to infinite sequences by i{a) n := i{a <n ) n for all a £ C w and n £ N. 
Many useful properties of 1 carry over from finite to infinite sequences: 1 is injective and 
computable. Also, l{C u ) is closed and 1(76"") = L^y)C w n t(C w ) for all 7 £ C*. 

After "stretching" the game g by using 1 to insert dummy nodes, let us add the fatal 
nodes F := {i{^)cd | 1(70) = l{^)ccq A d £ C — {co}}. These are the nodes that an agent 
would hit just after not playing as prescribed at a dummy node. 

Let us now split C w \l{C^) into two disjoint open sets Wf and Lp as below, respectively 
making the agents b and a lose when not playing the dummy moves as prescribed. 

W F := (J 7 C W L F := [j 7 C" 

7€FnC 2 * 7€FnC 2 *+ 1 

Note that every winning strategy for a player in g' := (C, i(W) U Wp) can be straight- 
forwardly converted into a winning strategy for the same player in g. Finally, to show that 
g' is determined, it would suffice to show that l(W) U Wf is quasi-Borel whenever W is 
quasi-Borel. This last step might actually be also doable for other interesting classes of sets, 
hence the following abstracted summary, which is then invoked in the proof of Theorem [321 

Lemma 3.1. Let C / 0, let T C P(C W ) ; and assume the following. 

• If S £ T and E is an open set of , then l(S) U E £ V . 

• The game (C, W) is determined for all W £ T. 

Then the game (C, D, W') is also determined for all W' £ T and D C C* . 

Theorem 3.2. Let A be non-empty, let C have at least two elements, let O be non-empty 
countable, and for all a £ A, let -< a be a binary relation over O. Then the following two 
propositions are equivalent. 

(1) -<~ l is strictly well-founded for all a £ A. 

(2) For all d : C* — > A and v : C w — > O, i/v _1 (o) is quasi-Borel for all o £ O, the game 
{A,C,d,0,v,(^ a ) a€ A) has a Nash equilibrium. 

Proof. Let us first prove 2 1 by contraposition. Assume that -<~ 1 is not strictly well- 
founded for some a £ A, so -< a has an infinite ascending chain (o n )„ e N, that is, o n -< a o n+ \ 
for all n £ N. Let ^(7) := a for all 7 £ C*. Let c£ C, let v (c w ) := o and let v(c n a) := o n+ \ 
for all n £ N and for all a £ {C — {c})C w (infinite sequences that do not start with the 
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choice c). For all o G O, i> -1 (o) is quasi-Borel since it is either empty, or an open ball, or 
the closed set {c w }. The game {A, C, d, O, v, -< a ) has no Nash equilibrium nonetheless, since 
every strategy (profile) of agent a induces one for some k and may be improved upon by 
a strategy profile inducing 0^+1- 

1 2 may be proved by Theorem 12.91 where V is instantiated with the quasi-Borel sets, 
so let us check whether the hypotheses hold. First hypothesis, O is countable and therefore 
well-orderable (by the enumeration that witnesses its count ability). Second hypothesis, by 
assumption -K" 1 is strictly well-founded for all a € A. Third hypothesis, let O'CO and 
7 € C*. Since u _1 (0') = [j{v _1 (o) | o € O'} is a countable union of sets that are quasi- 
Borel by assumption, it is also quasi-Borel by definition, so by intersection with an open 
ball, v~ l (0') HjC^ is still quasi-Borel by definition. The fourth hypothesis may be proved 
by Lemma 13. 1\ so let us check whether the hypotheses hold. The second hypothesis was 
proved by Martin [7j, so it suffices to prove that the quasi-Borel sets are closed under the 
insertion function i. Let us proceed by transfinite induction, which is possible thanks to 
the quasi-Borel hierarchy that is described just before Lemma 1.1 in [7]. 

• Base case, let W be an open set, so W is the union UjgjTjC^ of some basic 
clopen sets. Since l(jjC u ) = t(7j)C"" n l{C u ) by property of l, the set t(W) = 
Uj g j/.(7jC w ) = (Uj g ji(7j)C aJ ) ru(C^) is the intersection of an open set and a closed 
set, so it is quasi-Borel. 

• Let W come from complementation of C U \W , so by induction hypothesis t(C J \VF) 
is quasi-Borel. Since t(C u ) is closed and i(W) = l(C u )\l(C u \W) by injectivity, it 
is quasi-Borel. 

• Let W come from a countable union U n <=nW n , so iiW) = U ne Ni(W n ) is a countable 
union of sets that are quasi-Borel by induction hypothesis, so it is quasi-Borel, too. 

• Let W come from an open-separated union Uj^jWj that is witnessed by Wj C 
Uj e /7j ) jC" J for all j € J, where all the 7j,jC w may be assumed pairwise disjoint. So 
W = UigjjejWj n r yj,i.C UJ is an open-separated union witnessed by Wj n 7j,jC w C 
Tj^C"^. Since all the subclasses of the quasi-Borel sets are closed under intersection 
with clopen sets by Lemma 1.1 in [7], the WjPijj^C^ are all below W in the hierarchy, 
so each t(Wj n JjiC^) is quasi-Borel by induction hypothesis. Therefore the open- 
separated union i(W) = Ui e i i j e ji(WjC\'yj i iC^) that is witnessed by t{Wj ^lj,iC u ) C 
''(T?,*^) — i (7j,i)C a; (by property of t) is also quasi-Borel. 

□ 

Now let us justify explicitly why Theorem 13.21 is. indeed, a generalisation of quasi-Borel 
determinacy. Let T be a tree and G(W;T) be a game as in [7], where W is a quasi-Borel 
set of [T], the infinite paths of the tree. Let A := {a, b} be a two-element set; let C be the 
set of all elements that occur in the sequences of T, let d map C 2 * to a and C 2 * +1 to b; let 
O := {w, 1} be a two-element set; let v map to w all the elements of W union "fatal" clopen 
sets that make b lose when playing outside of T, and let v map the rest of to I; finally, 
let ^ a := and ^b'-= The preferences are obviously strictly well-founded, 

■u^du;}) is quasi-Borel, so the game {A, C, d, O, v, (^. a )aeA) has a Nash equilibrium by 
Theorem 13.21 Restricting this Nash equilibrium to T yields a strategy profile for G(W;T), 
and one of the strategies involved is a winning strategy. 

Furthermore, since the notions of strict well-foundedness and acyclicity coincide on finite 
domains, Theorem 13.21 is also a proper generalisation of the result [1] [5] already mentioned 
in the abstract and in the end of Section 11.31 
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Eventually, the second application of Theorem 12.91 is the following corollary, assuming 
that the axiom of determinacy (AD) holds for every countable C. The proof of 1 2 may 
invoke Lemma 13. II and the proof of 2 => 1 may be copied from the proof of Theorem 13.21 

Theorem 3.3. Assume AD. Let A and O be non-empty sets with O countable, and let C 
be a countable set containing at least two elements. For every a E A let -< a be a binary 
relation over O. Then the following two propositions are equivalent. 

(1) -<~ l is strictly well-founded for all a € A. 

(2) Every infinite sequential game {A,C,d,0,v, (~<a)aeA) ^ as a Nash equilibrium. 
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4. Conclusion 

Theorem 13.21 generalises quasi-Borel determinacy in a game-theoretic direction: it 
presents a general setting where strict well-foundedness is a necessary and sufficient condi- 
tion for existence of Nash equilibrium. This should be of interest to game theorists. 

Theorem 13.21 does not generalise quasi-Borel determinacy in a set-theoretic direction, 
though, since it involves only quasi-Borel sets. However, Theorem 12.91 savs that the existence 
of a Nash equilibrium in a game involving sets of a given complexity is a consequence of 
determinacy for these sets. Said otherwise, Theorem 12.91 suggests that using the concept 
of Nash equilibrium, instead of determinacy, is not likely to help refine the description 
of the complexity of sets, at least under well-foundedness assumptions. In this respect, 
Theorem 12.91 may be seen a negative result by set-theorists. 

There may be a positive set-theoretic side to this, nonetheless: since (quasi-)Borel de- 
terminacy was applied in several areas, it would be interesting to see how these applications 
may be generalised by invoking, e.g., Theorem 13.21 instead of (quasi-)Borel determinacy. 
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